

Sound in Nature 

© Collisions lead to surface vibrations 
© Vibrations create pressure waves in air 
© Pressure waves are sensed by ear 


Vibration Pressure Wave Perception 
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Physically Based Sound 

o Generate Sounds directly 
from physics 

o Current trend: Recorded 
Sounds 

o Problems with recorded 
sounds: 

Difficult, expensive or 
dangerous to record (eg. 
Explosions) 


Repetitiveness 


A typical foley studio* 


if 

CMP' 


* Image taken from: http://www.marblehead.net/folev/inclex.html 
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Xylophone: Short Demo 


Dices on Xylophone 

Playing "The Entertainer"' 

There are more than 350 collisions 
in this short clip. The audio simulation 
for this demo runs at >500 FPS 
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Challenges 

© Display: 30Hz 

© Haptics: 1000 Hz 

© Sound: 44,000Hz (at least) 

Human auditory range: 20-22000Hz 


© Simulation time-step must be -lO'^s 
© Stability may require even smaller time-steps 

Most sound-producing systems are very stiff 

o Scalability 
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Approach 

© Brute force physical simulation infeasible 
© Use analytical solution for surface dynamics 
© Exploit human auditory perception 
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Approach: Features 

© Simple to formulate and implement 

© Handles surface meshes with arbitrary 
geometry and topology 

© Handles both impact and rolling sounds 
elegantly 


o Runs in real-time, low CPU utilization 
(-10%) 

© Supports hundreds of sounding objects 
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Outline 

® Basic Approach 
@ Exploiting Perception 
@ Demos 
@ Summary 


® Acknowledgements 
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Overview 


Pre-processing 


T ransform 
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Frequencies 
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Spring-Mass System Modal Bank 


Runtime 
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Sinusoids Output 
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Modal Decomposition 



® Each mode represents a mode of vibration 
® Frequency of a mode is fixed 
® Applying impulse excites modes of vibration 
® Position of impact determines proportion of modes 
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Sound Synthesis 
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Excitation Sinusoids Output 


® Rigid Body Simulator provides impulses 

® Transform to mode amplitudes 

o Sound synthesized by adding the modes’ 
sinusoids 

© Adding damped sinusoids is very fast 
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Outline 

® Basic Approach 
® Exploiting Perception 
@ Demos 
@ Summary 
@ Acknowledgements 
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Mode Compression 

® Humans can’t distinguish two frequencies 
arbitrarily close to each other [Sek et. al., 1995*] 




*Sek, A., and Moore, B. C. 1995. Frequency discrimination as a function of 
frequency, measured in several ways. J. Acoust. Soc. Am. 97, 4 (April), 


2479-2486. 
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Quality Scaling 

© A typical audio scene consists of foreground and 
background sounds 

© Idea: Give more importance to foreground sounds 

© Higher intensity sounds are considered to be 
foreground 


© Provides a graceful way to adapt to variable 
time constraints 
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@ Summary 


® Acknowledgements 
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Implementation Details 

® System: 3.4 GHz Pentium 4 Laptop, 1 GB RAM 
® Graphics: GeForce 6800 Go, 256 MB 
® Sound: Creative Sound Blaster Audigy 2 ZS 
® Software 


SWIFT++ (Collision Detection) 


DEEP (Penetration Depth Computation) 

Pulsk (UNC In-house Rigid Body Simulation) 

G3D (Rendering) 

® OpenAL/EAX (Hardware Accelerated Propagation 
Modeling) 
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Position Dependent Sounds 
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Analysis 
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Rolling Sounds 
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Efficiency 
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Audio FPS 


Efficiency: Analysis 
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Realism 
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Summary 

® Simple formulation and easy to implement 

® Works on arbitrary surface meshes 

® Acceleration techniques exploiting 
auditory perception 


® Well suited for Games with their real-time 
requirements with variable time 
constraints 
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Thank You! 


Questions? 


http://qamma.cs.unc.edu/svmphonv 
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